Optional: Attention Mechanisms

Back to Home

01. Introduction to Attention
02. Encoders and Decoders
03. Elective: Text Sentiment Analysis
04. Sequence to Sequence Recap
05. Encoding -- Attention Overview
06. Decoding -- Attention Overview
07. Attention Overview
08. Attention Encoder
09. Attention Decoder
10. Attention Encoder & Decoder
11. Bahdanau and Luong Attention
12. Multiplicative Attention
13. Additive Attention
14. Additive and Multiplicative Attention
15. Computer Vision Applications
16. Other Attention Methods
17. The Transformer and Self-Attention
18. Notebook: Attention Basics
19. [SOLUTION]: Attention Basics
20. Outro

Back to Home

16. Other Attention Methods

11 Other Attention Methods V2

Paper: Attention Is All You Need

Talk: Attention is all you need attentional neural network models – Łukasz Kaiser

udacimak v1.3.0